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OUTLINE 


❖  SAGEM  Tactical  UAVs 

❖  Imagery  chain 

❖  3  rd  generation  IR  imaging  Payload 

❖  Image  processing 

❖  Automatic  target  recognition 

❖  Target  localization 

❖  Conclusions 
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SAGEM  :  EUROPEAN  LEADER  FOR  UAV 


From  Swedish  Lapland  Operation ... 


1993 


ynny 


2001 


1999 


1997 


1995 


...  to  Saudi  Arabia  Operation 
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H  BATTLE  &  FIELD  -  PROVEN 
H  MOST  ORDERED  SYSTEM  IN  EUROPE 

•  FRENCH  ARMY  (2+1+4  systems), 

•  DUTCH  ARMY  (4  systems), 

•  SWEDISH  ARMY  (3  systems), 

•  DANISH  ARMY  (6  systems), 

•  GREEK  ARMY  (3  systems) 

H  IN  FULL  RATE  PRODUCTION 


MAIN  SPERWER  SYSTEM  CHARACTERISTICS 


rHE  SYSTEM 

Ground  Segment 

Launcher 

AVs 


THE  MISSIONS? 

Artillery  (30m  CEP) 
Intelligence 


HIGHLY  TACTICAL 

*  Catapult  launch 

•  Parachute  recovery 
FLEXIBLE 


CAPABILITIES 


*  Multiple  payload  possible 

*  Hand  Over  between  ground  station 

*  2  aircraft  simultaneously 


NATO  INTEROPERABLE 


C4I  integrated  (Adat  P3) 

Ku-band  data  link  (STANAG  7085) 


Tactical  UAV  Mission 
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SPERWER  AIR  VEHICLES 

BCommon  avionics  SCommon  ground  segment 
SCommon  data  link  SCommon  logistic  support 


SPERWER  -  STANDARD  SPERWER  -  LONG  ENDURANCE 


MTOW  330  kg 
Span  4.2  m 
Speed  150  km/h 
Ceiling  4500  m 
Mission  radius  200  km 
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MTOW  350  kg 
Span  6.5  m 
Speed  148  km/h 
Ceiling  6000  m 
Mission  radius  200  km 
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IR  PAYLOAD  MUST  BE  ADAPTED  TO  THE  MISSION 
AND  THE  AIRCRAFT  SPECIFICS 

IRLS  8  - 12  M 


8  - 12  |j  IRIS  2nd  Generation  &  IR  3  -  5  n  MATIS  3rd  Generation  IR  Camera 
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OLOSP  &  ARTEMIS 
Stabilised  gimbal 
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Payload  system  control  and 
monitoring  Image  analysis 


DATA  BASE 


of  aj  $  i£:  ?l  fil'd!  Si  if 


MP  station 
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Mission  Exploitation 
(Image  analysis) 


MATIS  3-5  |jm  CAMERAS 


BINOCULARS 


MANPORTABLE  / 
STANDARD 


LONG  RANGE 
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SELECTION  CRITERIAS  for  IR  PAYLOAD 


★  Compactness  to  be  fitted  into  a  platform 
with  other  equipment’s  (visible  camera, 
Laser  Range  Finders/Laser  Designator,..) 

★  Consistency  with  the  mission  and  the 
environment 

★  image  quality  (high  definition) 

★  Sensitivity  (low  NETD) 

★  Maturity  of  technology 
★Affordable  cost 
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ATMOSPHERIC  TRANSMISSION 
Influence  of  the  Relative  Humidity 


Visibility :  25  km 
Transmission  1  km, 
—  Altitude  0  m 

Temperature  :  20°C 
Pressure  1013  mbar; 
1013  hPa 

100  {%) 


Visibility :  25  km 
Transmission  10  km, 
Altitude  0  m 
Temperature :  20°C 
Pressure  1013  mbar; 
1013  hPa 


Relative  Humidity  50% 


T 


A(nm) 


T 
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DIFFRACTION 


*  Angular  Resolution  is  Limited  by  Diffraction: 

a  =  1.22  XI 0 

a  :  angular  resolution  wavelength  0:  pupil  diameter 

*2  possibilities: 

□  Increase  0  :  Ineffective  as  already  limited  by 
the  available  space 

□  Decrease  X :  move  from  8-12  pm  to  3-5  pm 
thermal  imager,  X2.5  benefit  in  term  of  resolution 
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Background  limited  NETD  for  a  2  D  Array 


NETD 


min 


★  Nmax :  Maximum  storage 
charge  in  ROIC 
capacitance  (Nb  of 
electrons) 

★  Cat  :  Thermal  contrast  in 
the  bandwidth 
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MATIS  image  processing 

★  Usual :  non  uniformity  correction: 

O  Gain  table 

O  Shutter  to  show  a  uniform  scene 

★  improvement :  use  of  optical  flow  estimate 
from  scene  and  camera  movement 

=>  Better  image  quality 

=>  New  image  processing  capabilities 
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Optical  flow 


In  a  visible  image  sequence  ,  the  value  of  the  intensity 
l(x,y)  at  a  point  x,y  of  the  image  plane  may  fluctuate 
because  of  two  phenomena  : 

★  A  movement  of  the  scene  objects  or  a  movement  of 
the  camera, 

★  An  intensity  variation  of  the  scene  objects 


The  optical  flow  detection  consists  in  finding  the 
velocity  field  of  the  video  sequence  elements  in  the 
image  plane. 
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Optical  flow 


★  pixels  movement  2D  Field 


\  \  \  \ 

\  \  \  \ 
\  \  X  X 

\  XXX 


v  *  » 

\  \  " 
\  \  \ 


★  Basic  equation  : 

0I(x’ y-  dx(x,  y ,  t)  +  dy(x,  y ,  t)  XI(x’ 


dx 


dy 


dt 
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IR  Optical  flow : 
algorithm  description 


★  Hypothesis  : 

O  The  scene  optical  flow  is  principally  linked  to  camera 
movements 

O  In  the  IR,  intensity  is  a  combination  of  incoming  flux 
(through  the  lens)  and  a  parasitic  flux  (eg  narcisus). 

O  To  simplify  the  equation,  we  can  make  two 
observations  concerning  the  optical  flow  of  the  IR 
camera  : 

>  There  is  no  fast  movements  for  the  parasitic 
radiation 

>  Intensity  variations  are  linked  to  thermal 
Dhenomena,  and  consequently  have  time  constants 

e  that  are  broadly  superior  to  the  image  periodicity. 
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IR  Optical  flow : 
algorithm  description 


-  Image  pre  processing  :  to  avoid  aliasing 

-  Gradient  calculation 

-  Use  of  a  predictive  model  to  reduce  the  intensity  variation 

-  Select  N  more  convenient  pixels 

-We  express  movement  in  the  focal  plane  as  a  function  of  3 
angles  (roll,  yaw  and  pitch),  3  translations  and  a  zoom  factor  by  a 
projection  in  the  image  plane  of  the  movement  model 

-  These  expressions  are  injected  in  the  Optical  flow  equation 
-We  solve  the  N  equations  by  least  mean  square  estimate 
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Application  of  optical  flow  processing 


The  suggested  processing  permits  to  achieve  successively  or 
simultaneously  the  following  functions  : 


•  the  non-uniformity  correction  of  the  IR 
sensor 

•  the  stabilisation  in  the  terrestrial  co¬ 
ordinate  system,  or  the  filtering  of  the 
carrier  vibrations 

•  the  extraction  and  the  tracking  of  the 
mobile  objects  in  the  scene 

•  the  generation  of  hyper  resolved 
images  combining  over  sampling  and 
restoration 


e  IR  image  without  any  correction 
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algorithm  description 
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Stabilisation  of  IR  image 


Original  movie 
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Filtered  and  stabilised  movie 


Stabilised  and  Referenced  movie 
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Increased  resolution  with  motion 


Hyper-resolution 


Image  Processing  Chain 


Calibration  - 
Restauration 


Hyper¬ 

resolution 


Stabilisation 


Deblurring 


Calibration 
with  OF 


Wiener  filter 


Contrast 

Enhancement 


Dead  pixel 
correction 


Low  Level 
Processing 


High  Level 
Processing 


Moving  Target 
Detection 


Region 

segmentation 


Texture 

analysis 


Edge  extract. 


Hot  spots 
detection 


Monocular 

Stereo 


Fusion  (s) 


3D  position 
estimation 


ANN 


Fussy  Logic 


Bayes  Class. 


Voting  process 


Correlation 


Sensor  /  Navigation  Fusion 


Optical  Flow 
Motion 
Analysis 


Kalman 

filtering 


Tracking  / 
Association 
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Automatic  Target  Detection,  Recognition, 
Identification  and  Localization 


★  Automatic  generic  target  detection  and  recognition  : 

O  vehicle  type  target :  plane,  tank,  truck,  ... 

O  infrastructure  target :  bridge,  building,  .... 

★  Multi-bands,  multi-contexts  target  identification 

★  Precise  complex  target  localization  helped  with 
target’s  area  model 
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Generic  Target  Detection  and 
_ Recognition _ 


Preliminary  designation  : 

Target  type 

—  —  Raw  localization 


Generic 

Targets 

Models 


tranche  Security 


Detection 

] 

t _ 

Alarms 

selection 

- 

_ i 

r 

Alarms 

Segmentation 

ir 

Alarms 

Classification 

— 

IMAGES 


Nav.  Information 


UAV  Flight 


Target’s  precise 
localization 
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Generic  Target  Detection  and  Recognition 


«  Airplane  »  target  «  Helicopter»  target 
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Generic  Target  Detection  and  Recognition 


«  Tank  »  target  «  Truck  »  target 


e 

Branche  Defense  et  Securite 


Generic  Target  Detection  and  Recognition 


Navigation 

Information 


f  3D  Generic  ^ 
Models 


TTi 
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IMAGES 


Projected 
3D  Model 


-> 


Selected 
3D  Generic 
Model 
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Low  Level 

Features 

Extraction 
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r 
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Selection 
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Research  of 
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Parameters 
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r 

Alarms  Notation 
and  selection 
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Generic  Target  Detection  and  Recognition 


5D  10D  T5D  ZOO  250 
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Target  Identification 


3D  Models:  geometry 
(facet)  +  radiometry: 
(emissivity,  temperature) 


(Ray 

tracing, sensor 
model) 


+• 


35 
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Target  Segmentation  _ _ 


Image:  distance 
to  edge 


Models  Data  Base 

*r  A 


Shapes  for  each  position:distance/target 


Shape  recognition 
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MARDER 


Target  Identification 


AMX10 
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Identification  result 


Input  Image 


Identification  result 
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TARGET  LOCALIZATION 

★  Performance  constant  and  independent  from  GCS/AV 
distance 

★  Automatic  real  time  calculation  (no  human  interpretation) 

★  Target  co-ordinates  available  from  video  and  still  images 

★  Relative  co-ordinates  :  Accuracy  6  m 


Accurate  LOS 
posiiijoj-j  jnsasursmem 


PsiyJoad  /  l/jyftia 
Navigations  Urtft 
boresighting 


1/2  angular 
cone 

Target 

Location  Error 

65° 

<  50  m 

10° 

<  20  m 

(CEP  50,  altitude  1000  m) 
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GPS, 

■md  Navigation 
Systemss ... 


Ground  station 
Localisation 


Target 

Localisation 
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Target  localization  improvement  by  image  processing 


Mission  planning 


Observation 

Means 


Target’s  area  modelinc 


V 


Target’s  area  model 


Automatic  +  manual 
offline  modeling  process 
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TARGET 

+ 
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ENVIRONMENT 

k 

In-flight  processing 


Onboard 
IR  sensor 


Low  level 
image  processing 
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High  level 
matching  process 


Extracted 

features 


Automatic  real-time 
modeling  process 
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Precise  Target 
localisation 


Conclusions 


IR  image  sequence  processing  can  offers  new 
capabalities  for  target  detection. 

★  Motion  is  usable  to  make  over  sampling  and  provides 
better  resolution  with  2D  arrays  by  aliasing  reduction. 

★  improved  target  detection,  recognition  and 
identification 

★  Precise  target  localisation  by  mixed  processing 
between  navigation  system,  image  datas  and  terrain 
modelling 

To  day,  large  FPGA  permits  fast  design  of  hardware 
implementation  from  new  algorithms 
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